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Abstract 

Constructing discrete models of stochastic partial differential equa- 
tions is very delicate. Stochastic centre manifold theory provides novel 
support for coarse grained, macroscale, spatial discretisations of non- 
linear stochastic partial differential or difference equations such as 
the example of the stochastically forced Burgers' equation. Dividing 
the physical domain into finite length overlapping elements empowers 
the approach to resolve fully coupled dynamical interactions between 
neighbouring elements. The crucial aspect of this approach is that the 
underlying theory organises the resolution of the vast multitude of sub- 
grid microscale noise processes interacting via the nonlinear dynam- 
ics within and between neighbouring elements. Noise processes with 
coarse structure across a finite element are the most significant noises 
for the discrete model. Their influence also diffuses away to weakly 
correlate the noise in the spatial discretisation. Nonlinear interactions 
have two further consequences: additive forcing generates multiplica- 
tive noise in the discretisation; and effectively new noise processes 
appear in the macroscale discretisation. The techniques and theory 
developed here may be applied to soundly discretise many dissipative 
stochastic partial differential and difference equations. 
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1 Introduction 

This article develops a systematic approach to constructing spatially discrete 
models of stochastic partial differential equations and stochastic semi-discrete 
equations (collectively denoted spdes). Although this article considers dif- 
ferential examples of the theory, following analogous deterministic results PQ, 
section [2] comments how the theory also underpins the modelling on a coarse 
grid of stochastic dynamics on a fine grid, and thence potentially across a 
multigrid hierarchy. Thus the research here contributes to understanding 
how stochastic information is transferred over levels of scale — an outstand- 
ing need as reported by Dolbow et al. [2] who summarised a wide ranging 
workshop. More recently, reporting a review of Applied Mathematics, Brown 
et al. [3J §2.1.3] similarly called for "new approaches for efficient modeling of 
large stochastic systems" . This article explores sound modelling of complex 
stochastic systems over large space domains. 

The aim is to use stochastic centre manifold (scm) theory and techniques 
to ensure the accuracy, stability and efficiency of relatively coarse spatial dis- 
cretisations of spdes. Understanding such SCM theory is best obtained via 
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stochastic normal form theory [I] developed because of the success of deter- 
ministic normal forms [51 e.g.]: a stochastic coordinate transform separates 
the coarse grid slow dynamics in the system from the fast subgrid dynamics; 
in the new coordinates the subgrid modes decay exponentially quickly from 
all initial conditions in a finite domain; leaving the slow modes to evolve on 
the stochastic slow manifold as a rigorous closure on the coarse grid. Related 
dynamical systems approaches by Blomker, Hairer and Pavliotis [5| supports 
stochastic Ginzburg-Landau model in pattern forming systems. Caraballo, 
Langa and Robinson [7] and Duan, Lu & Schmalfuss [8] proved the existence 
of invariant manifolds for multiplicative stochastic dynamics. Here, due to 
the stochastic effects over many length and time scales, the practical chal- 
lenge is to close on a macroscale grid the intricate spatio-temporal dynamics 
of a spde. Numerical methods to integrate stochastic ordinary differential 
equations are known to be delicate and subtle [91 e.g.]. We surely need to 
take considerable care for spdes as well [TQl HTJ e.g.] in order to model the 
subgrid microscale nonlinear interactions. Modern dynamical systems theory 
provides a requisite careful methodology. 

The sound methodology for modelling spdes presented here has the po- 
tential to find future applications underpining multiscale modelling in areas 
such as climate, materials science and the biosciences [21 e.g.]. For example, 
the gap-tooth scheme of Kevrekidis et al. [121 H31 E] is often implemented 
with particle simulators. Coupling patches of the stochastic microscale dy- 
namics of such particle simulators, analogous to the coupling of stochastic el- 
ement developed here, will be an important generalisation of coupling patches 
with deterministic dynamics [15] to the stochastic dynamics explored herein. 

Earlier research developed a dynamical systems approach to discretis- 
ing deterministic pdes JTHl e.g.] and briefly looked at the specific case of 
stochastic linear diffusion [17]. Others proved the appearance of stochastic 
Ginzburg-Landau models in pattern forming systems [6j, and the existence 
and uniqueness of global solutions to the Burgers' spde ([2]) [181 EE]- Sec- 
tion [2] significantly extends new theoretical support to the dynamical systems 
discrete modelling of the general nonlinear spde 

— — = £(u)u+ ctf(u) + credit, x,t) , (1) 
ot 

(adopting the notation of most physicists and engineers) for a stochastic 
field u(x, t) evolving in time t in one spatial dimension, where £(u) is a 
smooth, second order, dissipative operator, f (u) denotes smooth, determin- 
istic, perturbations (possibly involving derivatives of the field u), and 4> de- 
notes the stochastic effects in the spde. When necessary for definite theoret- 
ical statements and for displayed numerical simulations, we adopt boundary 
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Figure 1: an example microscale simulation of one realisation, u(x, t), of the 
stochastically forced Burgers' spde (j2]), with nonlinearity <x = 3 and noise 
intensity a = 1 . This simulation uses a fine space-time mesh with Ax = 7t/1 6 
and At = 0.01 but plotted every 19th time step. 



conditions for the spde (JTJ of L-periodicity, u(x + L, t) = u(x, t), and assume 
initial conditions lie within the finite domain of validity of the SCM theory. 
Section [2] discusses that the spde (JTJ) not only includes the class of spdes 
differential in space, but also, such as when £ and f are discrete operators on 
a lattice, a wide class of microscale stochastic discrete difference equations. 
The analysis also applies to many microscale lattice stochastic rules. 

Typical issues and results are illustrated herein via the definite example 
of discretising in space the stochastically forced nonlinear Burgers' equation: 

3u 3u 3 2 u . , . 

3r + au ^ = 3^ + ff4,(x ' t) - (2) 

The simulation of the Burgers' spde (j2j) in Figure [T] illustrates complicated 
microscale fluctuations and their cumulative appearance in the macroscale. 
Givon et al. [201 P-R58] similarly used specific example problems to develop 
and illustrate many issues in their approach. The aim here is to estab- 
lish stochastic centre manifold (scm) theory and techniques as a practical 
approach to ensure the accuracy, stability and efficiency of numerical dis- 
cretisations of SPDES. 

Even discretising linear spdes has subtleties. Consider stochastically 
forced, linear diffusion in space (Burgers' spde (j2J) with a = 0). The simplest 
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finite difference approximation on a regular grid in x, say Xj = jh, for some 
constant grid spacing h, is 

^ = ^'- 2 ^-' +W), ,3) 

where U, is the value of the field u(x, t) at the grid points X,. However, 
the systematic analysis of specific earlier research [T7] recommends we use 
instead 

3Uj u j+ i - 2Uj + u j _ 1 \ [7 , i n. , „ , , , /ta 
-9^ « — — ^ -+° [V^ " iVs^ 1 - 2 ^j + Vi) + V^i 

(4) 

for some independent noise processes ih, and xp^ . That is, the point sam- 
ple (J)j(t) = 4>(Xj,t) of the noise, as invoked in ([3]), is better replaced by two 
components: a component ij)j(t) which is uncorrelated across the grid points; 
and a component ib, (t) whose direct influence distributes over the evolution 
of neighbouring grid values. The rationale is that spatial diffusion on the 
subgrid microscale between the macroscale grid points weakly correlates the 
noise applied to each grid value [17]. We use the stochastic centre manifold 
theory of Boxler [21] to account explicitly and systematically for such subgrid 
microscale physical processes and interactions. 

Subgrid microscale processes are especially important for nonlinear sys- 
tems. One example is furnished by the stochastic, Burgers '-like, spatially 
discrete, fine grid equation 

dxi" 4 ex 

— = -2lli + lli_i) - -114(114+! -ui_i) + o-cpi(t), (5) 

where subscript i indexes the fine grid, the first term on the right-hand side 
is a diffusive-like dissipative reaction with neighbours, the second term rep- 
resents a form of nonlinear advection of strength <x, and the last term is 
an additive stochastic forcing independent at each grid point but of uni- 
form strength o\ The theory described in Section [2] for the spde ([I]) also 
supports the modelling of (0) on a coarser grid with twice the spacing. Ex- 
tending earlier research for deterministic systems pQ, define coarse grained 
amplitudes Uj(t) = u 2 j(t), our coarser grid model of §d§ is 



oc\x 

M>jo(t)--g-iVMt) 



1 ~ —(U^-ZUi+U^O-^U^Um-U^O+a 

L ° (6) 

To this level of approximation the coarse grid evolution (jH]) is the same form 
as the fine grid (jSJ) with appropriately renormalised diffusion and nonlinear 
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advection, but with noise now weakly correlated with its neighbours as the 
coarse grid noise is the multigrid restriction il>j = |4>2j-i + + z4>2j+i , 
and with a new multiplicative noise arising from resolving the subgrid inter- 
action between the nonlinear advection and structure in the subgrid noise. In 
contrast to other methods, stochastic centre manifold theory [21] provides a 
systematic approach to resolving the macroscale influence of such microscale 
stochastic nonlinear interactions. 

Section H] provides one resolution of the challenge to model mean effects 
on the grid values Uj, the macroscale, induced by the microscale processes 
and interactions, both linear and nonlinear. This issue of macroscale, grid 
value modelling closure is a longstanding problem in even deterministic dy- 
namics, let alone a reportedly outstanding need in stochastic dynamics. For 
example, should the advection term aiui* in Burgers' spde ([2]) be discretised 
directly? or as jOc[u 2 ) x ? or as the 1 : 2 combination of these suggested by 
Fornberg [22] and used to improve stability [23l e.g.]. Which is better? The 
traditional approach of considering the discrete modelling of each term sep- 
arately does not tell us. Instead, to find a sound discretisation we consider 
the interaction of all terms in the spde by resolving subgrid scale processes 
and hence determine how the macroscale grid values can capture these sub- 
grid scale processes. Section 13.21 discusses a case of Burgers' spde (T2]) where 
traditional straightforward numerical approximations miss all of the easily 
apparent effects of the microscale noise on the macroscale discretisation. Here 
we develop further and validate the stochastic centre manifold (scm) method- 
ology for closure of macroscale discretisations. The wide ranging reports of 
Dolbow et al. [2] and Brown et al. [3] identify such closure as an outstand- 
ing challenge in multiscale modelling of stochastic physical systems of great 
interest to applied mathematics. 

1.1 Divide space into overlapping finite elements 

The method of lines discretises a deterministic pde in space x and inte- 
grates in time as a set of ordinary differential equations — sometimes called a 
semi-discrete scheme [231 EH e.g.]. Similarly, this article only discusses the 
relatively coarse grained spatial discretisation of spdes and treats the result- 
ing set of stochastic ordinary differential equations, such as the SDE as a 
continuous time, stochastic dynamical system. Earlier research [25] explored 
how to model the Burgers' spde ([2]) in just a small domain of one element 
and focussed on how to handle the complicated microscale interactions of 
noise in an spde. This article not only establishes theoretical support for 
a wider range of spdes, it focusses on the vastly more complicated nonlin- 
ear interactions of noise not only within but also between near neighbouring 
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spatial elements. 

Place the spatial discretisation of a nonlinear SPDE ([T]), such as Burgers' 
SPDE d2J), within the purview of SCM theory by the following artifice. Let 
equi-spaced grid points at Xj be a distance h apart. The jth element is 
notionally |x — X,| < K/2 but we extend and overlap the elements to be 
I* ~~ Xj| < H. Let there be m such elements. Following the analogous 
and proven approach to discretising deterministic pdes [THl ESI e.g.], 
form overlapping finite elements by introducing artificial, nonlocal, coupling 
conditions (ccs) between neighbouring elements: 

Uj(X j±1 ,t) = (1 -y)uj{X h t) +YUj±i(Xj±i,t), (7) 

where u,(x, t) denotes the subgrid microscale field of the jth element. The 
coupling parameter y controls the flow of information between adjacent ele- 
ments: when y = , adjacent elements are decoupled by the CC ([7j); whereas 
when y = 1 , the CC (j7|) requires the field in the jth element to extrapolate to 
the neighbouring elements' field at their grid point. Others found similarly 
overlapping elements useful in several multiscale methods [281 El EH e.g.]. 
The specific coupling ccs (0) used here ensure discrete models are consistent 
with deterministic pdes to high order in H as the element size h — •> , both 
linearly [25], and nonlinearly and in multiple space dimensions [271 §4]. 

Importantly, Section [2] establishes that the methodology developed with 
the CCs (0) applies to a wide variety of continuum and discrete SPDEs, not 
just the example Burgers' SPDE (j2}. 



1.2 Model nonlinear stochastic dynamics 

This paragraph focuses on nonlinear interactions rather than stochastic in- 
teractions between elements. Sections [3] and H] construct the following low 
order, discrete system of SDEs of the nonlinear dynamics of the stochastically 
forced Burgers' SPDE (J2J): 



— ~ ^(i + ^ 2 h 2 uJ)(u j+1 - 2Uj + u H ) - a luj(u j+] - u H ; 



at 



2h 



7T^ 



7 8h 2 j 



2h 

.01643a 2 hVlL 



This model is for the case when the subgrid microscale noise within each 
element is truncated to the first three Fourier modes: 



4>(x, t) = cb^oW + <4>j ,i (t) sin[7r(x - X,)/H] + (J) j)2 (t) cos[27t(x - Xj)/h] 
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The first line of the discretisation (J8J) is the so-called holistic discretisation 
for the deterministic Burgers' equation which has good properties on finite 
sized elements [30j; in particular, the nonlinearly enhanced diffusion pro- 
motes stability of the scheme for non-small field u. The second line of the 
discretisation flH]) approximates some of the stochastic influences. Analogous 
to the coarse graining modelling (JSJji — >(EI), the nonlinearity in the subgrid 
microscale dynamics of Burgers' equation transforms the additive noise of 
the spde ([2]) into multiplicative noise components in the discretisation, such 
as 4>j,iUj. Many modelling schemes miss such multiplicative noise terms be- 
cause they do not resolve the subgrid microscale processes that are revealed 
by the SCM methodology. 

As seen in Figured! stochastic forcing typically generates microscale spa- 
tial structures with high wavenumber, steep variations. Through a form 
of stochastic resonance, the life-time of these modes may be important on 
the large scale dynamics. For example, the last term of the discrete model 
SDE OH]), being proportional to o" 2 Uj, arises from nonlinear self- interactions of 
subgrid scale noise, as discussed in Section H~2"l Herein the term 'stochastic 
resonance' includes phenomena where stochastic fluctuations interact with 
each other and themselves through nonlinearity in the dynamical system 
to generate not only long time drifts but also potentially to change stabil- 
ity [311 ED E2] [331 EH e.g.]. Coarse grained discrete model SDEs, such as 
([H]) and (jl]), which use large space-time grids for efficiency, must account 
for such subgrid microscale dynamics in their closure in order to resolve the 
significant subtle interactions. 

Stochastic averaging similarly derives mean effects on slow modes from 
fast time stochastic effects [351 e -S-]> an d complicated deviation arguments 
estimate fluctuations [22]. However, in discretising the spde ([I]) there is only 
a finite scale separation between slow and fast modes: in forming discrete 
models there is no asymptotically small parameter e measuring an asymptot- 
ically infinite scale separation as required by stochastic singular perturbation 
theory. Dolbow et al. [2, p. 30] specifically call for "new multiscale mathe- 
matical methods developed and used to derive multiscale models for some of 
the 'difficult' cases in multiscale science; e.g., problems without strong scale 
separation,". Our application of SCM provides such a methodology. 

Stable implicit integration schemes do not resolve subgrid microscale fluc- 
tuations. For example, recall that the well established Crank-Nicholson 
scheme for spatio-temporal dynamics is based upon the stability of the im- 
plicit scheme 



U-t+At ~~ u t 



At 



= -(3 



2 



for the ODE u 



|3u. 
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The solution is indeed stable, 



1 - |3 At/2 
1 + (3 At/2 



) 



t/At 



u(t) =u(0) 



and accurate for small |3 At. Thus in general such schemes preserve noise 
characteristics, such as drift and volatility, of the evolution of slow macro- 
scopic modes which have small rates (3. However, the dynamics of microscale 
modes, with large (3At, are badly misrepresented by such schemes when em- 
ploying a macroscopic time step of relatively large At; for example, any ex- 
ponential decay of microscale modes is badly simulated by near oscillations 
in the Crank-Nicholson scheme. Such bad representation may be acceptable 
in deterministic pdes where the microscale modes are not forced. But in 
a SPDE, with broad spectrum noise, the microscale modes are continually 
forced and their life-time requires reasonable resolution. The methodology 
proposed here provides a systematic method to derive macroscale closure of 
the microscale noise. 

Stochastic centre manifold theory supports the large time macroscopic 
modelling of detailed stochastic microscopic dynamics, even when there is a 
finite scale separation between 'slow' and 'fast' modes. Knobloch & Wiesen- 
feld pTj and Boxler [21], [37], for example, explicitly used SCM theory to sup- 
port the modelling of SDEs and spdes. Boxler [21] proved that "stochastic 
center manifolds, share all the nice properties of their deterministic coun- 
terparts". Many, such as Berglund & Gentz [38], Blomker, Hairer & Pavli- 
otis [6] and Kabanov & Pergamenshchikov [39], use the same separation of 
time scales that underlies SCM theory to form and support low dimensional, 
long time models of SDEs and spdes that have both fast and slow modes. 
Similarly, Bensoussan & Flandoli [40] proved the existence and relevance of 
finite dimensional stochastic inertial manifolds for a wide class of stochastic 
systems in a Hilbert space. Stochastic normal form theory of Arnold [H SU 
e.g.] also supports the existence and relevance of stochastic centre manifolds. 
Centre manifold theory also supports the discretisation of deterministic par- 
tial differential equations [301 12E1 S3 S3 SU SS] . Section [2] merges these two 
applications of theory to model spdes with sound theoretical support. Cou- 
pling neighbouring finite elements together forms macroscale discrete models 
of spdes such as (J4]), ([6]) and The major complication is to account for 
noise and its subgrid dynamics which are distributed independently across 
space as well as time, both within elements and between neighbouring ele- 
ments. Computer algebra — given in full detail, documented and freely avail- 
able for checking and modification on an institutional preprint server [46] 
conveniently handles the fearsome details of the nonlinear subgrid dynamics 
and the interelement interactions in the stochastic centre manifold modelling. 
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We discuss the forcing (b( x > t) as a white noise that is delta correlated in 
both space and time. However, computational limitations often require the 
truncation to a few Fourier modes as in (jHJ). Nonetheless, most of the analysis 
and models in Sections [2] and [3] also hold for deterministic forcing fy{x, t). 
Further, correlated noise 4> could be handled in the same dynamical systems 
approach by introducing auxiliary spdes such as 

for some white space-time noise £, and convolution kernel Q[x). The stochas- 
tic c() would then have spatial correlations with power spectrum oc 1 /|{?(k)| 2 
for Fourier transform Q of the kernel Q[x). Consequently, this approach 
encompasses quite general noise processes. 

Herein, interpret all noise processes and equations in the Stratonovich 
sense so that the rules of traditional calculus apply. Thus the direct appli- 
cation of this modelling is to physical and engineering systems where the 
Stratonovich interpretation is the norm. 

2 Stochastic centre manifold theory under- 
pins modelling 

This section details one way to place the spatial discretisation of spdes 
within the purview of stochastic centre manifold (SCM) theory. The theory 
was elaborated by Arnold [H Chapt. 7], or see the freely available concise 
summary [25j Appendix A, e.g.]. Subject to some conditions, extant SCM 
theory assures us of the existence and relevance of discrete models of the 
general spde ([T]). When a definite example is discussed we invoke the Burg- 
ers' spde (T5]), or the discrete microscale dynamics of ([5]). Earlier related 
work [33] was limited to linear differential dynamics and invoked different, 
less practical, interelement coupling conditions. To proceed, first we embed 
the dynamics of the spde ([I]) into a higher dimensional stochastic system. 
Then from the base of a subspace of equilibria, this section establishes the ex- 
istence and emergence of a stochastic slow manifold that forms the macroscale 
discrete model. The key here is simply to establish the preconditions for the 
application of stochastic centre manifold theory. Then the established SCM 
theory rigorously supports a wide range of models and illuminates a wide 
range of modelling issues — to obtain useful results we only need to verify the 
preconditions. 

The first step is to embed the dynamics of the spde ([1}) onto the overlap- 
ping elements of Section [TTTl Recall that Uj(x, t) denotes the stochastic field 
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in the jth element X,-_i < x < Xj + i . Then on each element solve the spde (Tj[|) 
with the field in the jth element, namely we analyse the set of SPDEs 

-^j- = C (iij )uj + ocf (uj ) + a4>j (uj , x, t) , (9) 

where (bj is the noise term on the jth element. Couple the fields in neigh- 
bouring elements with the CC (J7J). Such coupling of overlapping elements 
appears analogous to the 'border regions' of the heterogeneous multiscale 
method [28, e.g.], to the 'buffers' of the gap-tooth scheme [HI e.g.], and to 
the overlapping domain decomposition that improves convergence in wave- 
form relaxation of parabolic pdes [29j e -g-]- When necessary for definitive 
theory and for numerical simulations, the L-periodic boundary conditions 
(L = mh.) for the global field u(x, t) require that the fields in the ru ele- 
ments satisfy Uj± m (x± L, t) = Uj(x, t) for all x and elements j. Equivalently, 
consider the spde in the interior of a domain large enough so the physi- 
cal boundaries are far enough away to be immaterial. That is, the analysis 
throughout assumes space and time are statistically homogeneous so that 
the resultant discretisations are statistically homogeneous as seen in (jlj), ([6]) 
and OH]). Evidently, the set of SPDEs OH]) form a higher dimensional stochastic 
system that effectively reduces to spde flU) in the limit of full coupling. 

I avoid defining a precise probability space for analysis of the SPDEs ([9]). 
The reason is that extant theorems place differing conditions of the nature of 
the functions £{u), f (u) and 4)(u, x , t) appearing in the SPDE; see CorollaryU] 
for examples. Herein we primarily develop a formal methodology applicable 
to all established rigorous theoretical conditions, but flexible enough to cater 
also for a wide class of physically interesting stochastic systems. 

Second, we anchor the discrete modelling upon the subspace of equilib- 
ria Eo of piecewise constant solutions, u, = U, = constant, with no noise, 
= , no interelement coupling, y = in the CC ([7]), and no nonlinearity, 
a = . For each of the equilibria in Eo it is straightforward to find the linear 
Oseledec spaces that form the foundation of the SCM J25J p. 212] as here they 
are then standard linear eigenspaces. Linearising about each equilibria, for 
small perturbations uj(x, t) the dynamics of the spde (]T]) with coupling con- 
ditions ([7]) reduce to that of dissipation within each element isolated from its 
neighbours: 

du! 

— L =C ] u such that ul[X»± u t) = u {X h t), (10) 
ot ' ' ' 

where the prime denotes a perturbation to the equilibrium field of each ele- 
ment of Eo and C] = £(Uj); for example, Burgers' spde (j2]) linearises to the 
diffusion equation u[ = u^ x . 
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The linearised problem ffTUl) has dissipative dynamics on each of the m ele- 
ments. Assume the spectrum {0, — Pji, — (3j2, . . .} of the dissipative operator Cj 
is discrete with negative real parts bounded away from zero (apart from the 
single zero eigenvalue): > — 13 > fR(— |3ji) > £H( — |3j2) > ••• for all el- 
ements j. For example, the linearised problem (TlOj) for Burgers' spde (j2J) 
is spatial diffusion which within each element has spectrum given by the 
negative of the decay rates (3^ = 7r 2 k 2 /h 2 , for integer k = 0,1,2,...; the 
corresponding (generalised) eigenfunctions in each element are the mode£] 

coskG for even k, sink0 for k > 1 , 9sink9 for even k> 2, (11) 

where the subgrid variable 9 = n[x— Xj ) /h. measures subgrid position relative 
to the centre grid point within each element (the jth element lies between 
9 = ±7t). The k = mode, u oc constant in each element, is linearly 
neutral as its decay rate (3o = . Thus, linearised about each equilibria 
in the subspace Eo, subgrid structures within each element decay so that 
a global piecewise constant field emerges exponentially quickly — at least as 
fast as exp(— |3t). 

SCM theory asserts that such emergence is robust to nonlinear and stochas- 
tic perturbations. To address stochastic effects we need to expand the noise 
in a complete set of basis functions. Because we embed the dynamics in 
overlapping elements with 'overlapping' eigenfunctions, such as (jlip . choose 
a subset Vi<,(x — Xj) of the eigenfunctions that are complete over the non- 
overlapping domains |x — X,| < K/2; for Burgers' spde (J2]) decompose the 
noise within each element as a linear combination of 



v . f cosk9, for even k, , N 

Xj)=csnk9 = < . , Q ' jj i (12, 

' [ sin k9 , for odd k. v ' 



Vic x 



This decomposition is analogous to Example 5.2.2 of Da Prato & Zabczyk [T9l 
see also p. 259]. Thus additive noise in the element spde for the Burgers' 
SPDE is 

oo oo 

*j(x,t) = ^4> J)1t (t)v k (x-x J ) = 2I c M t ) csnke ' ( 13 ) 

k=0 k=0 

where (b,^ denotes the noise process of the kth wavenumber in the jth ele- 
ment. Assume the noise processes {4>j,k} are independent. Simple numerical 



1 The corresponding adjoint (generalised) eigenfunctions are (1 — |0|/7t) cosk9 , sink0 
and sink|0| because the adjoint boundary conditions to those in (|10p are u! — at 
x = Xj±i , U- is continuous at Xj, and the nonlocal derivative condition u- x {X^,t) — 
u, / x (^- ) t)=u 1 ' x (X J+ i,t)-u 1 ' x (X,_ 1 ,t). 
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methods, such as Galerkin projection onto the coarsest mode Vo, would ignore 
the 'high wavenumber' subgrid modes v^, k > 1 , of the noise ([TBI and hence 
miss subtle but potentially important subgrid and inter-element interactions 
such as those seen in the models (jlj), (|SJ) and (|HJ). In contrast, the system- 
atic nature of our application of SCM theory accounts for subgrid microscale 
interactions as an asymptotic series in the noise amplitude cr, inter-element 
coupling y and nonlinearity a. 

2.1 A stochastic slow manifold exists 

The nonlinear forced spde (jUj) with inter-element coupling conditions ([7J) 
linearises to the dissipative pde ffTOl) . To account for non-zero parameters, 
adjoin the system of three trivial DEs de/dt = 0, where e = (cx,y, <x) . In 
the extended state space (u, e) = (ui, . . . ,u m , cr, y, a), the linearised pde 
has m + 3 eigenvalues of zero and all other eigenvalues have negative real 
part < — (3: this upper bound is — 7i 2 /h. 2 for the example of Burgers' spde (j2J). 
Thus the SPDE Q has an m + 3 dimensional slow subspace. Because of the 
pattern of the eigenvalues, SCM theory [25j Theorem 3, p. 212] assures us a 
corresponding m+3 dimensional stochastic slow manifold (ssm) exists under 
certain conditions. 

Corollary 1 (existence) For Lipschitz nonlinearities C[\i), f(u) and ($>[u), 

and in some finite neighbourhood of the equilibria, (Eo,0), there exists an 
m + 3 dimensional SSM for the general spde in which the field in the 
)th element is Uj = Wj(U(t),x, t, e) where the )th component Uj of vector U 
measures the amplitude of the neutral mode Vo(x — Xj) in the )th element, 
and where the amplitudes Uj evolve according to Uj = (U, t, e) for some 
function g,, but provided 

• either the nonlinear spde Q is effectively finite dimensional f21[ The- 
orems 5.1 and 6.1]; or 

• the noise in the spde Qj is multiplicatively linear in u, 4> = ui|)(x, t) 
147, Theorem A]. 

Analogously, Blomker et al. Theorem 1.2] rigorously proved the existence 
and relevance of a stochastic Ginzburg-Landau model to the 'infinite di- 
mensional' stochastic forced Swift-Hohenberg pde. Similarly, Caraballo, et 
al. [7] and Duan et al. jH] analysed the existence of invariant manifolds for 

2 A SPDE is effectively finite dimensional if there exists a wavenumber K such that 
modes for k > K do not affect, through £, f or <J), the dynamics for modes with 
< k< K. 
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a wide class of 'infinite dimensional' reaction-diffusion spdes with linearly 
multiplicative noise; they built on earlier work by Bensoussan & Flandoli [4"0] 
proving the existence and relevance of inertial manifolds of spdes in a Hilbert 
space. Wang & Duan [17] also proved the existence of attractive slow man- 
ifolds for a wide class of spdes but again only with linearly multiplicative 
noise. 

Unfortunately, many interesting physical problems do not have Lipschitz 
nonlinearity; for example, the nonlinear advection in Burgers' spde (J2J) in- 
volves the unbounded operator 3/3x. I expect future theoretical develop- 
ments should rigorously support this application. However, in the interim, 
let us proceed via a type of shadowing argument [25]. The rapid dissipa- 
tion of high wavenumber modes in applications such as Burgers' spde (T5]) 
indicates that the dynamics are close to finite dimensional: for example, I 
showed that resolving just ten subgrid modes in a modified Burgers' spde (jSJ) 
on a small domain was sufficient to give the coefficients of the evolution on 
a SSM correct to five digits [251 §4]. By modifying any spatial derivatives 
in an spde ([rj, such as the nonlinear advection in Burgers' spde (j2J), to 
have a high wavenumber cutoff (a low-pass filter), as done in Section^ the 
dynamics of an spde (pQ) is effectively that of a Lipschitz, finite dimensional 
system. The SCM theorems of Boxler [21J then rigorously apply. 

Others also invoke such a cutoff. For example, Da Prato & Zabczyk [T9]. 
p. 265] define a so-called 'mollifier' M.r(1c) which is identically k for ||k|| < R 
and which is zero for ||k|| > 2R. In essence, the 'wavenumber cutoff' (low- 
pass filter) of the previous paragraph performs the same regularising role as 
such a mollifer. 

Coarse grain stochastic lattice dynamics Instead of a field continu- 
ous in space x, suppose the microscale quantities and noise are known on a 
microscale lattice indexed by i as in the spatially discrete system (jSJ): for 
definiteness say Xi = ih/2 so that the coarse grid Xj has twice the spacing 
of the fine grid x^. Then the microscale field is not the L-periodic contin- 
uum field u(x, t) but the 2m-periodic discrete u(i, t). Similarly the noise 
is defined only at microscale lattice points. Following earlier determinis- 
tic exploration [TJ, consider the stochastic lattice dynamics spde (P) when 
the dissipative operator is the specific second central difference £u(i, t) = 
(4/h 2 ) [u(i + 1 , t) — 2u(i, t) + u(i — 1 , t)] but the nonlinearity f and noise 4) 
may be quite general. Embed the lattice dynamics onto m overlapping el- 
ements to form the system fl9]) at internal lattice points and with the same 
coupling conditions (j7_J): the jth element consists of microscale lattice points 
Xi G {Xj, Xj ± jh, Xj ± H}. Such a discrete system has the same set of piece- 
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wise constant equilibria Eq. About each of these equilibria the linearised 
dynamics are the deterministic ffTUl) . The spectrum on each element, due 
to the second central difference C, is then simply {0, — 8/h 2 , — 16/fv 2 } cor- 
responding to microscale lattice eigenmodes (wavelets perhaps) on each el- 
ement of v = (1,1,1,1,1), vi = (0,-1,0,1,0) and v 2 = (1,-1,1,-1,1) 
respectively — as for the deterministic case pQ. Consequently, the Existence 
Corollary [T] then guarantees that for certain classes of lattice nonlinearity f 
and noise (() there exists a SSM describing an in principle exact closure, such 
as the approximate ([6]), on the coarse macroscale grid values of the microscale 
stochastic dynamics. 

It will not escape your notice that such sound mapping of stochastic 
dynamics from a fine grid to a grid a factor of two coarser, such as (jSD 1 — 
may be iterated across all grid scales on an entire multigrid hierarchy. This 
approach has the potential to explore stochastic microscale dynamics at any 
scale, and to strongly relate dynamics across any scales. Thus this approach 
contributes to the need identified by Dolbow et al. [2], p. 4] for "representing 
information transfer across levels of scale" , and the more recent call by Brown 
et al. [31 p. 14] for "adaptive multiscale discrete stochastic simulation methods 
that are justified by theory and which can automatically partition the system 
into components at different scales". 

2.2 The stochastic slow manifold captures emergent 
dynamics 

The second key property of SSMs is that the evolution on the SSM does capture 
the long term dynamics of the original SPDE (pQ), apart from exponentially 
decaying transients. For example, all solutions of Burgers' SPDE (T2J) close 
enough to the origin are are exponentially quickly described by the discrete 
SDEs (jHJ). This strong theoretical support for the model holds at finite element 
size h. — it ensures an accurate closure for the macroscale discretisation. 

Boxler's Relevance Theorem 7.1(i) [21] . or [251 Theorem 4, p. 213], and 
Wang & Duan's Theorem A [47] are rephrased in the following corollary (see 
also Theorem 2.3(iii) by Bensoussan & Flandolfi [10]) that, by the earlier 
argument, applies here to assure us that the dynamics on the SSM emerges 
exponentially quickly. 

Corollary 2 (emergence) For the conditions of Corollary [IJ there is a 
finite neighbourhood N of the equilibria, (Eq,0) ; such that for each solu- 
tion Uj (x, t) of the SPDE starting and remaining in the neighbourhood N , 
there exists a solution U(t) on the SSM such that \\uj (x, t) — w, (U, x, t, e) || — > 
as t — > oo almost surely. 
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Boxler also assures us that the rate of decay to the SSM is of the same 
magnitude as the decay of the gravest subgrid microscale mode J2Tj Theo- 
rem 7.1(1)], here exp(— |3t) . In Burgers' spde (|2J) for example, on times sig- 
nificantly larger than a cross element diffusion time H 2 /7t 2 , the exponential 
transients decay and the SSM model ([ED describes the dynamics. Similarly, 
the transients of the microscale dynamics fl^D decay on a time scale of h /8 
to the SSM model For stochastic systems, such decay to the SSM is most 
clearly seen via stochastic, normal form, coordinate transforms [HI EH IM1 
e.g.]. 

Subtleties in this Emergence Corollary mislead some researchers, even 
when modelling deterministic systems. For example, Givon et al. [20] discuss 
finite dimensional deterministic systems which linearly separate into slow 
modes x(t) and fast, stable modes y[t). They identify the existence of a 
slow invariant manifold y = r\ (x) and the low dimensional evolution on the 
manifold in the form X = LiX+f (X,r)(X)) . However, they assume [201 p.R67, 
bottom] that the initial condition for the evolution on the slow manifold 
is simply X(0) = x(0), and then consequently, just after their (4.5), have 
to place undue restrictions on the possible initial conditions. However, the 
source of such restriction is that in general X(0) 7^ x(0). Physicists sometimes 
call the difference between x(0) and X(0) the 'initial slip' [50] e.g.]. For 
stochastic systems, the correct nontrivial projection of initial conditions onto 
the SSM may be constructed via stochastic normal forms |4"T| |4"5 | e.g.] and 
applies in some finite domain around the subspace (E ,0). 

There are two caveats to our application of Corollary [2] to discretising 
SPDEs. Firstly, although our constructed asymptotic series are global in 
the m coarse macroscale amplitudes U, they are local in the parameters 
e = (cr, y, <x): the rigorous theoretical support applies in some finite neigh- 
bourhood of e = . At this stage we have little information on the size of 
that neighbourhood. In particular, we evaluate the model when y = 1 to re- 
cover a discrete model for fully coupled elements; thus we require y = 1 to be 
in the finite neighbourhood of validity. Such validity has been demonstrated 
for the deterministic diffusion equation and Burgers' equation [30], but not 
yet for the stochastic case. Secondly, we cannot construct the SSM and the 
evolution thereon exactly; it is difficult enough constructing asymptotic ap- 
proximations such as the low order accuracy models (jlj), ([6]) and ([8]). The 
models we develop and discuss have an error due to the finite truncation of 
the asymptotic approximations in the small parameters e. 

For example, the truncation in powers of the coupling parameter y con- 
trols the width of the computational stencil for the discrete models. Due to 
the form of the coupling conditions (J7J), nearest neighbour elements interac- 
tions are flagged by terms in y 1 , whereas interactions with next to nearest 
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neighbouring elements occur as y 2 terms, and so on for higher powers. The 
low accuracy models (j3j), ([HD and (jSJ) are constructed with error C(y 2 ) and so 
only encapsulate interactions between the dynamics in an element and those 
of its two adjoining neighbours. Construction to higher orders in coupling y 
accounts for interactions between more neighbouring elements. 



3 Nonlinear dynamics have irreducible noise 
interactions 

Using the specific example of the forced Burgers' spde (J2J), we now explore 
typical issues arising in the macroscale discretisation of the quite general 
nonlinear spde (JTJ), issues that arise for both differential and difference spdes. 



3.1 Separate products of convolutions 

As detailed elsewhere [17, §3.1], in the iterative construction of the SSM, 
Uj = Wj(U,x, t, e) = Uj + • • • such that dlij/dt = gj(ll, e), we use the 
residuals of the governing spde ([T]) to drive corrections, indicated by primes, 
via 

- £jWj + gjV = residual^} . (14) 

In analysing a nonlinear spde (JTJ, such as the stochastically forced Burgers' 
SPDE (j2J), products of memory convolutions appear in the residual. Just 
seeking terms quadratic in the noise magnitude a we generally have to deal 
with quadratic products of multiple convolutions in time. 



Obtain corrections from residuals To cater for the general case, define 
multiple convolutions. First, let the operator "H{ denotes convolution over 
past history with exp[— (3{t] where for brevity the fraktur t denotes the pair jk 
corresponding to the kth eigenvalue of the jth element. That is, 



rt 



H t (\) =exp[-p ( t]*4>(t) 



exp[-|3 t (t-T)]cMT)dT; (15) 



— oo 



recall that |3{ is the (positive) decay rate of the kth mode within the jth ele- 
ment; pjk = k 2 7r 2 /H 2 for the Burgers' spde (121), independent of the element. 
Da Prato & Zabczyk [T§J §5.2.1] discuss the existence and continuity of such 
stochastic convolutions. Second, let denote the operator of multiple con- 
volutions in time where the subscript vector t indicates the decay rate of the 
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corresponding convolution, that is, the operator 

Hi = / H[tuh,.:) = ex P( — P^t) * exp(— pt 2 t) * • • • * and "H = 1 , (16) 
in terms of the convolution (1151) ; consequently 

3tH (tlit2i ...) = — |3 tl H{i u t 2> ...) +^(t 2 ,...) • (17) 

The order of the convolutions does not matter [25]; however, keeping intact 
the order of the convolutions seems useful to most easily cancel like terms in 
the residual of the governing spde. 

Earlier work [T7J §3.3-4] explored updates w- and g- to the subgrid SSM 
field and the discrete model SDE for deterministic terms [30, e.g.] and terms 
linear in the noise 4) in linear diffusion. Summarising, in iteratively construct- 
ing the SSM we encounter convolution integrals over the immediate past of 
the noise. Such fast time 'memory' convolutions must be removed from the 
dynamics of the discretisation: Givon et al. [201 P-R59] similarly comment 
"Memory. An important aim of any such algorithm is to choose P [the SSM] 
in such a way that the dynamics in X [our grid values U] is memoryless." We 
simplify the discrete model tremendously by removing such 'memory' convo- 
lutions as originally developed for SDEs by Coullet, Elphick & Tirapegui [5.1], 
Sri Namachchivaya & Lin [52], and Roberts & Chao [53, 33] : the trick is to 
absorb the 'memory' convolutions into the parametrisation of the SSM, via w,, 
leaving the evolution on the SSM, gj, to be convolution free. The results are 
discrete models, such as (jlj) and ([6]), where the noise is correlated across 
neighbouring elements despite the originally uncorrelated noise in the linear 
diffusion SPDE. 

Nonlinear spatially extended problems, such as the Burgers' spde ([2]), 
need to adapt extra techniques from finite dimenisonal SDEs [521 E3J and from 
SPDEs on small spatial domains [25] . For nonlinear problems we additionally 
have to solve for corrections quadratic in the noise for each term in the right- 
hand side of the general form 

- />; + g!v Q = a 2 f j (x) U t ty, n U t 4>i,m , (18) 

where Fj (x) denotes complicated expressions encapsulating some of the influ- 
ences of surrounding elements upon the subgrid structures within the jth el- 
ement. Analogous to the treatment of linear stochastic terms [I7J §3.3-4], 
two cases arise. 

• Firstly, for each components of the subgrid structure Fj(x) in v p (x — Xj) 
for wavenumber p > 1 , there is no difficulty in simply including in the 
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correction to the subgrid field, w-, the component 

CJ^Vp (x — Xj) H iv [Hi 4>j )U Ut 4>i,m] 

with its extra convolution in time. 

• Secondly, for the component in Fj (x) that is constant across an element, 
the Vo(x — Xj) component, we separate the part of %z cbj !n "H* 4>i )Tn . that 
has a bounded integral in time, and hence updates the subgrid field wL 
from the secular part that does not have a bounded integral and hence 
must update the model SDE through g!. 

In the considerations and convolutions for either case, the surrounding grid 
values that appear in the spatial structure forcing Fj are treated as constants 
as the time derivative in (lisp is the partial derivative of Wj(U, x, t, e) keep- 
ing the grid values U constant. The g^ term in ([18]) accounts for the time 
derivatives of grid values U. 



Integrate by parts to separate Integration by parts introduced in ear- 
lier research [33] 125] also here reduces all non-integrable convolutions to the 
canonical form of the convolution being entirely over one of the noises in 
a quadratic term. Summarising, I define the canonical irreducible form to 
be (bj ;n 7i t 4>i, m . Then, rewriting the convolution ode (IT7I) as fitUtt' = 
— dtHtt' + H*' > where the vector of convolution parameters is decomposed 
as t = £ ■ t so that £ is the first component of vector t, and t ' is the vector (if 
any) of the second and subsequent components of vector t, for any 4> and ib, 
whether from the same element or not, 

Hw 4> Hw dt = — - — —^- r Ht.t'§'Hu''ty 



Pt + 0< 
1 

" (3 t + |3 e J 



Hi' 4) %w 4> + H t .t> (J) He dt . 



Observe that each of the two components in the integrand on the right-hand 
side has one fewer convolutions than the initial integrand. Thus one repeats 
this integration by parts until terms of the cannonical form 4)j >n 7-Li (t)i im in 
the integrand are reached. In this recursive process, assign all the integrated 
terms to update the subgrid stochastic field wL The irreducible terms re- 
maining in the integrand, those in the form 4>j jTl 7i( 4H,mj rnust thus go to 
update the stochastic evolution g-. 

Computer algebra [IH] §6] readily implements these steps in the iteration 
to derive the asymptotic series of the SSM of an spde (pQ). 
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Figure 2: microscale simulation of one realisation of the Burgers' spde (121, 
27t-periodic and from initial condition u(x, 0) = 1 , when the applied noise is 
simply onh(t) cos2x for a = 1 and nonlinearity ct = I . The macroscale grid 
points are at the nodes of this forcing, x = ^7r, |7i, |7t, , where the field u 
is relatively quiescent. 

3.2 Odd noise highlights nonlinear noise interactions 

Subgrid modes with even wavenumber k are the only modes to affect the dis- 
crete model of linear diffusion [T71 §3.3]. Consequently, restricting the forcing 
noise 4>(x> t) to have odd structure within each element highlights the nonlin- 
ear dynamics of spatially extended dynamics of the Burgers' spde 02), an d 
clarifies the modelling of subgrid nonlinear stochastic effects in the general 
SPDE dl]). 

One correlated noise The simplest nontrivial case of Burgers' spde ([2]) is 
when the noise ())(x, t) has just the one odd Fourier component sin 9 in each 
element, and is perfectly but oppositely correlated in neighbouring elements. 
That is, in this section set the noise in each element to be 

4)(x,t) = (-1 ) j 4>i (t) sin 9, (19) 

for the one 'white noise' 4>i (t). For example, Figure [2] shows a microscale sim- 
ulation of 27t-periodic Burgers' spde ([2]): as the macroscale element size h. = 
n/2 , the space-time structure of the noise fTT9l reduces to 4> = <j)i (t) cos2x. 
We proceed to model such microscale stochastic dynamics with four elements, 
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time t 

Figure 3: Compare the macroscale model fl2Tl) with a microscale simulation 
for larger noise amplitude cr = 1 and nonlinearity <x = \ (as for Figure [2]): 
blue, the microscale field u(X2,t) showing the subgrid noise carried by non- 
linear advection past the grid point; cyan, the macroscale variable U.2(t); and 
red, the macroscale SSM ( 122]) at the grid point, U2(X2,t) = W2(U, X2, t, e), 
for the shown U2 (t) — the SSM and the microscale simulation match well. 

with h = 7r/2, centred at Xj = (j — j)tc/2. Figure [2] shows that the nodes 
of the stochastic forcing (fT§|) are at these grid points Xj. Most methods for 
discretising Burgers' spde ([2]) on these elements, such as the simple collo- 
cation point sampling scheme ([3]), would sample or average over this noise 
and predict it has no influence whatsoever on the macroscale grid evolution. 
However, the subgrid scale nonlinear advection in Burgers' spde (J2J) carries 
the subgrid scale noise past the grid points and so generates fluctuations in 
the grid values: these fluctuations are hard to see in the simulation of Fig- 
ure El but are clear in the plots of Figure [3] In contrast to most methods for 
discretising spdes, our holistic discretisation provides a systematic closure 
for the subgrid microscale dynamics and so predicts these fluctuations in the 
grid values. 

Computer algebra jl6] constructs the SSM of Burgers' spde ([2]) with in- 
terelement coupling ([7]): just modify the code to the specific forcing (TT9l) . 
In each element, and with noise induced, subgrid structures truncated to 
the first eight subgrid Fourier components 1, csnG, . . . , csn 79 , the subgrid 
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microscale field is 



Uj(x,t)=Uj+y -|x5 + — -S 

_7t Z7t z 



e . e 



2 



Uj ± a sin 9 U\ cbi 



2h 4 

— Hi -- (} cos 29 ft 2 ,i - ii cos 49 H 4 ,i +^ cos 69 H 6)1 ) 



7T 2 ' h 

+ C(a 3 + a 3 +y 3/2 ) , (20) 

where the upper alternative is for even j, and the lower alternative for odd j. 
The terms in the second line of the SSM ( 121}]) begin to account for the nonlinear 
advection and interaction of these subgrid spatial structures: these processes 
transform the additive forcing into multiplicative noise, Uj(bi, with memory 
via the convolutions "H p j . Higher order terms in the coupling y, nonlinear- 
ity a and noise magnitude cr are too onerous to record for the microscale 
subgrid structures. 

A third SCM theorem of Boxler [3T] Theorem 8.1] justifies the asymptotic 
error reported in the SSM fl20|) . This error comes from the termination crite- 
rion of the iterative construction of the SSM. Computer algebra [46J iterates 
until the residual of the governing Burgers' spde fl2]) (or the fine lattice dy- 
namics and the residual of the interelement coupling conditions (|7|), are 
of some specified asymptotic order of error. Boxler 's [21] Theorem 8.1 then 
guarantees that the SSM model constructed by the computer algebra has the 
same asymptotic order of error, as reported in the SSM ( 120]) . 

One may straightforwardly check by hand the error of an SSM, such 
as ([20]) . by direct substitution into Burgers' spde ([2]) and the coupling condi- 
tions ([7]). However, the algebraic details are enormous, reflecting the intricate 
subgrid scale noise interactions and including the transformations outlined 
in Section 13.1] and would fill many pages with otiose algebraic expressions. 
Table [1] tabulates the number of terms of various orders for the evolution on 
the SSM of the Burgers' spde fl2]): the number of terms describing the SSM, 
higher order versions of f[2"0~]) . is several orders of magnitude more. Surely it 
is far better to leave such intricate detail to a computer, and focus instead 
on the stochastic model, its theoretical support, and its implications as we 
do here. 

The construction of the SSM (120]) proceeds 'hand-in-hand' with construct- 
ing the evolution on the SSM. Iterating to higher order in the small param- 
eters e, computer algebra [IB] gives that with the simple noise ( 1H?]) . the 
emergent evolution of the grid values Uj(t) on the SSM (120]) is the system of 

SDES 
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+ o^a 2 



in- 



■Uj + y (.1 028 Uj + .071 6 6 2 Uj) - .00363 <x 2 h 2 U, 3 
8 

7t 



— Uj(|)i (1^2,1 +2^5^4,1 +1^5^6,1 )4>1 

O^ + o^+y 572 ) . 



+ 0.0195 h 2 Uj 4), ft, 4)i 



4>i 



(21) 



The terms in the first line form the deterministic holistic discretisation of 
Burgers' equation [3U]. The second line gives the terms linear in the noise: 
as for linear diffusion [T7J §3.2-3], we remove all memory convolutions from 
the terms linear in noise. However, the terms in (T2~T]) quadratic in noise, a 2 , 
generally must contain memory convolutions (as discussed in Section 13. ip in 
order to maintain the SDEs (1211) as a strong model of Burgers' SPDE (j2J). 

Figure [3] shows U.2(t) for one simulation of the discrete model SDE (12T|) 
for noise magnitudes cr = 1 (cyan curve). Compare these to the blue curve 
of the field u(X2,t) at the corresponding grid point. Although the overall 
trends are roughly similar, the macroscale variable LbCt) is markedly differ- 
ent to u(X2,t). How then can the SDE (|2ip be a strong model? Resolve 
the difference by recalling that to eliminate memory convolutions we must 
abandon the freedom to impose precisely the meaning of the amplitudes U, 
[25] §3, e.g.]. Thus, generally, U2(t) ^ u(X2, t) . Instead, the field at a grid 



point, u(Xj,t) 
namely 

udX b t) 



is predicted by the SSM ( 120]) evaluated at the grid points, 



2h 



7T Z 



Hi 



4 
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n 



4,1 



~i n ^ ) 



+ 0(a 4 + a 4 +y 2 ) 



(22) 



Figure [3] plots the SSM predicted grid value (122]) in red and displays good 
agreement with the microscale simulation (blue). Evidently, SCM theory 
successfully supports discrete macroscale models of nonlinear spdes. 



3.3 Strong models of stochastic dynamics are compli- 
cated 

Now restore independent and multiple noise processes in each element and 
consider the details of discretisations of the stochastically forced Burgers' 
SPDE d2J). Computer algebra [16] derives the following leading terms in the 
asymptotic series of the model dllj/dt = gj(U, t, e). The large amount of 
algebraic detail reflects the enormous complexity of the multiple physical 
interactions acting on the subgrid microscale structures forced by the rich 
spectrum of stochastic noise. The arguments of the next section simplify the 
model significantly. Scan past the following model to the discussion. 
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Computer algebra derives that the element amplitudes Uj(t) evolve ac- 
cording to the system of SDEs 

+ [y^S 2 - y 2 (^ + ^)6 4 ] cb ji2 - a^U^,, 

+ ^U j (l<J)y+(i + ^) l l64) jll ) 

01,2 1 

" ^ ((1 + 3^)^,1 - (i + ^)6 2 4)j,i)] - « 2 3^^*j,o j 

+ a ^j~^2 ( _32( t ) j,0'Hl > 2 M-6 - g4>j,1 %2,2 S 2 + f (j)j,2^1,2 M-S) 4>j,2 

+ ay^ [4) ji0 (Jr ft, ^(fyo + cb j)2 ) + + 6%j 

-{\ + %)U 2 + *J,1 ^2 (J6 2 * j)0 - (i + 15^)^,2) 

+ (fry (-£ «1 ^(4>j,o + « - + ^r) «i 5 2 4)j,i 
+ (| + 5^)H 2 ^4) j)2 ) 

+ S 2 cb j ,o «i H^ + T^) + ^ + ^ 2 ) (Dj.1 

-5 2 *},1 ^(^ + ^) + (^ + b^)S 2 ) 4>j,2 
-6 2 cj>,2 H 1 ((^ + ^) + (^ + ^)6 2 ) ^ 

+ Jlfi^ + ^) JlScfr,,, + (J - ^) « 2 *, J] 

+ a 2 ^Uj [-^cb j)0 (2%, 2 +%H 2 ) *j,2 

- £4>j,i (^2,1 -¥^1) + T§*j,2 (2H 1>2 +gH 2 ) cb j(2 ] | 
+ 0(cx 3 ,<x 3 +y 3 ) . (23) 

The model resolves noise, nonlinearity and inter-element interac- 
tions The discrete model SDE (125]) is computed to residuals C(cr 3 , oc 3 +y 3 ) 
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Table 1: number of terms in the evolution dlij/dt = gj(U, t, e) when only 
three Fourier modes are used for the subgrid stochastic structures: the num- 
bers in italics report the terms evident in ([23]) . Expect many more terms 
when using more Fourier modes. Blank entries are unknown. 
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and hence, supported by Boxler (211 Theorem 8.1], the model has the same 
order of error [251 Theorem 5, p. 213]. The SDEs ( 123]) build on earlier models 
of stochastic linear diffusion [TTJ §3.4] recovered when one sets the nonlin- 
earity parameter <x = in (1231) . The truncation to errors ensures the 

model retains the interesting mean effects generated by the quadratic noise 
interaction terms parametrised by cr seen in the last 14 lines of the SDEs (1231) . 
The truncation to error 0(<x 3 +y 3 ) resolves linear dynamics within and be- 
tween next nearest neighbour elements, and nonlinear dynamics within and 
between nearest neighbour elements. 

Computer memory [46J currently limits us to the first few subgrid Fourier 
modes, 1 , sin 0, cos 29, for this modelling of Burgers' spde fl2]). In modelling 
the microscale lattice dynamics ([5]) these three noise modes are complete, 
so in the application to coarse graining to (|6]) the analysis accounts for all 
possible microscale noise. Table [T] indicates the level of complexity of the 
multi-parameter asymptotic series via a type of Newton diagram. The ta- 
ble reports the number of terms in various parts of the discrete model SDE 
Uj = gj(U, t, e) (there are vastly more terms describing the subgrid mi- 
croscale structure w, (U, x, t, e) of the SSM within each element) . // we pursue 
either higher order truncations or more Fourier modes, then the complexity 
of the model increases alarmingly. Rational resolution of the subgrid scale 
stochastic interactions, in order to determine their macroscale effects, suffers 
from a combinatorial explosion in terms. Thus, for the moment, truncate 
the model as in (123]) . 

Abandon strong stochastic modelling The undesirable feature of the 
discrete model SDEs (123]) is the inescapable appearance in the quadratic 
noise terms of fast time convolutions, such as "Hi cbjj = exp(— (3it) * 4h and 
^1,2 4>j,2 = ex P( — Pit) *exp(— *(f>j,2 • These require resolution of the sub- 
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grid fast time scales in order to maintain fidelity with the original Burgers' 
SPDE (|2J) and so would require incongruously small time steps for a suppos- 
edly slowly evolving model. However, maintaining strong fidelity with the 
details of the white noise source 4>(x, t) is a pyrrhic victory when we are only 
interested in the relatively slow long term dynamics of the element ampli- 
tudes Uj(t). Instead, we need only those parts of the quadratic noise factors, 
such as (bj,o%i 4^,1 an d (bj,o %1,2 that over the long macroscopic time 
scales emerge as a mean drift and as new noise. The next section develops 
such stochastic weak models in the context of a coarse grid discretisation. 



4 Stochastic resonance influences determin- 
istic dynamics 

Chao and Roberts [531 E31 ES] argued that quadratic terms involving memory 
integrals of the noise were effectively new drift and new noise terms when 
viewed over long time scales (as also noted by Drolet & Vinal [SI])- The 
arguments rely upon the noise being stochastic white noise. The strong 
model SDE f )23|) faithfully tracks any given realisation of the original Burgers' 
SPDE ([2]) [2Tj Theorem 7.1 (i) , e.g.] whether the forcing is deterministic or 
stochastic; however, this section proceeds to discuss how to derive a system 
of SDEs that weakly model on a macroscale a given spatially extended SPDE. 

Analogously, Just et al. [22] argued that fast time deterministic chaos 
appears as noise when viewed over long time scales. 



4.1 Transform quadratic noise interactions 

In the strong model (1231) we need to understand and summarise the long 
term effects of the quadratic noises that appear in the form cbj Hk 4h an d 
<bj 4h j where here 4h and (bj represent the various possibilities for the 
components (bj^- The noises may be independent (s = 0) or they may 
be the same process (s = 1 ) depending upon the term under consideration. 
Thus we explore the long term dynamics of Stratonovich stochastic processes 
iji and y2 defined via the SDEs 

%- = 4>jft k 4>i and ^ = cb j ^ lc (b i . (24) 
at at 

Summarising earlier research [53| l33| [25] . first name the two convolutions 
that appear in the nonlinear terms f )24l) as Z\ = Ti^ 4h and Z2 = "H^k cbi: then 
we must understand the long term properties of yi and yz governed by the 
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coupled system of sdes 



yi =zi4»j, zi = -(3 k Z! + 4>i, 

y2 = z 2 cpj , z 2 = -p«z 2 + Zi . (25) 

Deterministic centre manifold theory applied to the Fokker-Planck equation 
for the system (T251) proves [251 §4] that as time t — > oo the probability density 
function for the SDE f l25|) tends exponentially quickly to a quasi- stationary 
distribution [511 e.g.]. The quasi-stationary distribution evolves according to 
a Kramers-Moyal equation which we interpret as approximating a Fokker- 
Planck equation for a system of SDEs (the neglected terms represent alge- 
braically decaying non-Markovian effects among the y variables [551 equa- 
tion (11)]). This established analysis [251 §4] of the Fokker-Planck equation 
for system (pM|) models the system's long-time dynamics by the SDEs 

dt-^ s+ v2^ dt -pk+pA^ vw" l j 

As proved previously [251 Appendix B], and analogous to the argument of 
Just et al. [551 equation (11)], the two i|>i(t) are new noises independent of 
(bt and (bj over long time scales. For the case of identical (bi and (bj (s = 1 ) 
there is a mean drift I in the stochastic process yi; there is no mean drift in 
the other case of independent cbi and (bj (s = 0). 



4.2 Transform the complicated strong model to be use- 
fully weak. 

The challenge for our macroscale discretisation of a spde is to handle the 
enourmous number of interacting noise processes in spatially extended non- 
linear spdes. For Burgers' spde (J2J) the decay rates pk = 7T 2 k 2 /h 2 . Thus, 
via various instances of the sdes f[26"l) . to obtain a model for long time scales 
we replace the quadratic noises in f[23l) as followsH 

<bj,n Ilk 4>i,m >-> ^jS^ + ^J^ lbnmk(t) , 



4>j,n ?4,« (bi, m (-> 



h 3 



7t 3 (k 2 + £ 2 ) 



(27) 



where ib nm k and ib n m«k are the effectively new independent white noises; that 
is, they are derivatives of new independent Wiener processes. I omit the 



3 Note that 6ij and 6 mn , with its pair of subscripts, do not denote a centred difference 
but rather denote the Dirac delta to cater for the self interaction of a noise when there is 
a mean drift effect (s = 1), or not (s = 0), as appropriate. 
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subscripts of i and j on i[> and henceforth on 4> because they are redundant 
when we record the model using centred mean and difference operators. 

Computer algebra [46, §9] implements the transformations (12T1) to the 
strong model SDEs ( 123]) to derive the corresponding weak system of SDEs 

^=4 62u >-^ 54u <-^4 u <^ 

+ a [4) - 2026ah\X^ - .02738<x 2 H 2 U 2 4)2] 

+ yob 2 (-.041 67c()o + .025334)2) + Y 2 ^ 4 (.005971 $ Q - .002752cb 2 ) 

+ ahy0{(a.6Uj [.02533c|) 2 + .051 1 1 v-bfa] 
+ 6 2 Uj [-.020314)! + .012786 2 4) 1 ] 
+ Uj [\x& (.082134)o - .02533cb 2 ) + .025555 2 4) 1 ] } 

+ ahV (-.04561x|>oii + .004561xb 122 + .009122xb 21 i) 

+ ah 2 ycr 2 [\i5 2 (.01849xl> 00 i + .01849xf> 02 i - .01479x|) 02 i 2 - .01 949x^22 

- .003697\L> 201 - .003697\b 221 + .002958xL> 2 2i2 + .003828xb 2 22) 
+ fx6i (.001002\))o22 + .000501 1xl> 222 ) 

+ \ib^b 2 (.0115-4>oii - .0009038x|) 12 2 - .001808xb 2 ii) 
+ b\ (.005752^on + .000231 1i|)i 02 - .0007858^ U 2 

- .0001 155-ipi222 - .0009038\l)2ii) 

+ b] (-.002209\L) ii - .0004519x1)! 22 - .002496xb 2 i i ) 
+ b]b\ (.002876x1)011 - .000226xl) 122 - .000451 9xJ) 211 )] 

+ c^hVlij (-.004929x]) 02 i 2 - .008626xl) 022 + .004929^ m 

- .0002465x1)! 112 - .0001 232xL)! 12 + .0009859xb 2212 + .001725xi) 222 ) 

+ .01643ot 2 fiVu j + C(a 3 ,a 3 +y 3 ) , (28) 

where \ib-\ and b 1 denote differences in the first grid variable implicit in 
the noises x|), whereas \xb 2 and b\ denote differences in the second implicit 
grid variable. The value of the weak model SDE (12"51) is that it has no fast 
time scale processes. The complexity of the weak model SDE fT2"5j) reflects 
the intricacies of the inter-element interactions and the subgrid microscale 
processes resolved in this systematic approach to discretising spdes. 

The SDEs (1231) and (|28|) may look very complicated, but the difference 
operators hide even more complexity in the stochastic components of the 
weak model SDE (|2"gj) . and the strong model SDE (T2l?j) . Any one apparent 
noise symbol tynmk represents 5m independent noise sources over all the 
m elements. In order to clarify all the discrete differences of i\> n mk that 
appear, temporarily reinstate the implicit subscripts. For the jth element we 
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need the nine noise components xbjjnmk, 4>j±i,jnmk, tpy±i,umk and ^j±i,j±i, n mk 
in order to compute all the differences that appear in the SDE (|28|) . Of 
these, seven of the noises are used in computing the differences in the (j ± 
1 )th element, and two are also used in computing the differences in the 
(j ± 2)th element. Consequently each of the try noises that appear in the 
SDE ([25]) actually represent, in nett effect, five independent noise sources 
for each element. Such terms reflect subtle cross-correlations between the 
stochastic dynamics within neighbouring finite elements. 

Stochastic induced drift affects stability The terms quadratic in the 
noise magnitude, indicated by a factor cr, are particularly complicated. With 
relatively small numerical coefficient, for many practical purposes we might 
ignore all except the last known term in the SDE fl28|) . namely +.01 643cx 2 h 2 cr 2 Uj 
The positive coefficient of this term shows that the self interactions of each of 
the many subgrid microscale noises act to promote mean growth of macroscale 
structures in the dynamics of Burgers' spde (j2J). Indeed, because of its po- 
tential importance, I included this mean effect in the introductory model 
SDE flHJ). 

Similarly, Boxler [2TJ p.544], Drolet & Vinals j5HE2], Knobloch & Weisen- 
feld |3T] and Vanden-Eijnden [MJ p. 68] found stability modifying linear terms 
in their analyses of stochastically perturbed bifurcations and other nonlinear 
systems. 

4.3 Consolidate the emergent noises 

Orthonormalisation simplifies the representation of the effects of all the noise 
terms in the weak model SDE ([28]) : this section reduces the 16 quadratic 
noises to just seven equivalent noise sources. The novelty here is to do so 
for all the interacting elements. Because the noise terms appearing in (|28|) 
are unknown in detail, we replace linearly independent combinations of them 
by one equivalent noise term, as for the discretisation of linear diffusion [T71 
§3.4]. 

• Because of the severe truncation in the number of retained Fourier 
modes, there is no significant simplification possible in the terms linear 
in the noise magnitude cr that appear in (|28|) . 

• Now turn to the quadratic noise terms in the SDE (1251) . Computer 
algebra [4*6j §9] extracts the eight different combinations of noises il> 
in the SDE (1251) . Then a Gramm-Schmidt orthonormalisation of the 
vectors of coefficients is essentially a QR decomposition of the transpose 
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of the matrix of noise coefficients: namely, factor the noise contributions 
to R T Q T ip where ip is the vector of noise processes, Q T is an orthogonal 
matrix, and R T is a lower triangular matrix. Then x = Q 1 ^ are a vector 
of new independent noise processes to replace ip. For our weak model 
SDE (1281) . only the first seven rows of R T are non-zero, and hence only 
the first seven components of the new noises x are significant. Thus 
seven new noises x> with coefficients in R T , replace the 16 noises ip. 

Computer algebra [46, §9] computes the QR factorisation of the quadratic 
noise coefficients in the weak model SDE (128]) . but extends to the case of four 
subgrid Fourier modes, instead of the three subgrid Fourier modes used to 
compute ff28l) . There is a significant difference in the amount of detail: with 
truncation to four subgrid Fourier modes the weak model (l2"gj) has 92 terms 
in its centred difference form; in comparison, with truncation to three Fourier 
modes the weak model (1281) has 53 terms in its centred difference form. How- 
ever, upon replacing the quadratic noises i|) by equivalent noises x the re- 
sultant weak model has complexity largely independent of the number of 
retained subgrid Fourier modes. The model from four subgrid Fourier modes 
is 

+ a [fa + cxhllj (-.20264)1 + .022524) 3 ) - .02555 ot 2 h 2 U^ 2 ] 

+ ycx6 2 (-.041 67cp + .02533 fa) + Y 2 o-S 4 (.005971 4) - .002752fa) 

+ ahyo-{^6Uj [.025334) 2 + |xS(.051 1 1 fa - .00649 fa)] 

+ 5 2 Uj [(-.020314)! - .OOOM&fa) + 5 2 {.0]278fa - .001622cp 3 )] 
+ Uj [n5 (.083144)o - .02533 fa) + 5 2 (.025554) 1 - .003245 fa)] } 
+ . 04681 ctfiVxi 

+ otfi 2 ya 2 [|x5 2 (.02163x2 + .02949 X3 ) 

+ n5i {-.0006027x2 - .0001 1 1 X 3 + .0008305x 4 ) 

+ 1x5^2 (-.01168xi + .000587xs) 

+ S 2 (-.005875xi + .0001334x5 + .00041 03 X6 ) 

+ 5 2 (.001 608xi - .002696x5 - .0005] 92 Xe + .001 1 1 6 X7 ) 

+ 5 2 5 2 (-.00292xi + .0001468x5)] 
+ .01126cc 2 hVu j X2 + .01751a 2 h 2 cr 2 U j + C(a 3 ,a 3 +y 3 ) . (29) 

In this weak model, the new noises Xn implicitly have two more subscripts to 
parametrise noise in pairs of nearby elements, as for ib nm ic : these reflect some 



30 



of the subtle correlations between neighbouring elements. The multitude of 
nonlinearity induced quadratic noise interactions have been replaced by just 
seven completely equivalent noise processes x (although, as discussed earlier 
for ip, these seven implicitly represent five times as many independent noise 
processes per element). Again, because many of these quadratic noise terms 
have small coefficients, they may be neglected depending upon the parameter 
regime being explored, resulting in considerable simplification. However, it is 
the multitude of such small noise interactions that lead to a significant mean 
drift effect. The outcome of this section is that it is practicable to keep track 
of the multitude of interacting subgrid noises to extract important macroscale 
effects such as the mean drift term .01 751 oc 2 H 2 a 2 Uj. 

5 Conclusion 

The virtue of the final weak model SDE f[29]) . as also recognised by Just 
et al. [53], is that we may accurately take large time steps as all the fast 
dynamics are eliminated in the systematic closure. The critical innovation 
here is that we have demonstrated, via the particular example of Burgers' 
SPDE (J2]), how it is feasible to analyse the net effect of many independent 
subgrid microscale stochastic effects, both within an element and between 
neighbouring elements, in a quite general SPDE (JTJ). General formulae for 
modelling quadratic noise interactions [25] , together with the iterative con- 
struction of stochastic slow manifold models [53 [17], empower us to model 
a wide range of spdes, both differential and difference. 

Theoretical support for the models comes from dividing the spatial do- 
main into finite sized elements with coupling conditions (J7J, invoking SCM 
theory [21], and then systematically analysing the subgrid processes together 
with the appropriate physical coupling between the elements. This approach 
builds on success in discretely modelling deterministic pdes [3Ql|26jlI51 e.g.]. 
This theoretical support applies to stochastic difference equations on a spa- 
tial lattice, such as ([5]), as well as to stochastic differential equations, such 
as Burgers' SPDE 

What about spatial domains with physical boundary conditions at their 
extremes? The coupling parameter y controls the information flow between 
adjacent elements; thus our truncation to a finite power in y restricts the 
influence in the model of any physical boundaries to just a few elements 
near that physical boundary. The approach proposed here is based upon the 
local dynamics on small elements while maintaining fidelity, via SCM theory, 
with the global dynamics of the original SPDE. In the interior, the methods 
described here remain unchanged and thus produce identical model SDEs. 
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The same methodology, but with different details will account for physical 
boundaries to produce a discrete model valid across the whole domain. Such 
modelling incorporating physical boundaries has already been shown for the 
deterministic Burgers' pde [44 J and shear dispersion in a channel [4"5] . 

Future research may find a useful simplification of the analysis used here 
if it can determine the mean drift terms, quadratic in a 2 , without having 
to compute the other quadratic noise terms. Techniques from stochastic 
averaging may help here [351 e.g.]. 

This approach to spatial discretisation of the spde ([I]) may be extended 
to higher spatial dimensions as for deterministic pdes |45l [581 EZ] • Because 
of the need to decompose the stochastic residuals into eigenmodes on each 
element, the application to higher spatial dimensions are likely to require 
tessellating space into simple rectangular elements for SPDEs. 
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